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DETAILED ACTION 
Response to Amendment 

1 . The Examiner acknowledges Applicant's submission on 6/2/05, wherein amendments 
were made to claims 1, 29 and 56 by canceling claims 8, 35 and 57 and placing them in their 
respective independent claims 1, 29 and 56. All pending claims are rejected, wherein the 
previous rejection has been maintained. 

Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis 
for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 29-34, 36-56 and 58-86 are rejected under 35 U.S.C. 102(b) as being clearly 
anticipated by "Adjustable Filmstrips and Skims as Abstractions for a Digital Video Library" 
(Christel et al.), herein referred to as Christel. 

Referring to claim 29, Christel discloses a method of presenting information regarding a 
video with a plurality of frames (page 2, column 2, lines 11-19). Christel discloses identifying a 
plurality of different segments of the video, where each of the segments includes a plurality of 
frames of the video (page 4, column 2, lines 8-32). Christel discloses displaying, simultaneously 
with a segment of the video, a graphical user interface including information regarding the 
temporal location of the segments, relative to at least one other of the segments of the video 
(Figure 5). Christel discloses displaying the temporal location for a first type of content of the 
video using a first visual indication (Figure 5), wherein this is represented as the gray blocks at 
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the bottom of the window and displaying the temporal location for second type of content of the 
video using a second visual indication different from the first visual indication (Figure 5), 
wherein the white lines showing the match locations represents the second visual indication. 

Referring to claim 30, Christel discloses a generally rectangular region where each of the 
plurality of segments is indicated within the generally rectangular region (Figure 5). 

Referring to claim 3 1 , Christel discloses that the size of each of the plurality of segments 
is indicated in a manner such that the plurality of segments with a greater number of frames are 
larger than the plurality of segments with a lesser number of frames (Figure 5). 

Referring to claim 32, Christel discloses that the size of the regions between each of the 
plurality of segments is indicated in a manner such that the regions between with a greater 
number of frames are larger than plurality of segments with a lesser number of frames (Figure 5). 

Referring to claim 33, Christel discloses an indicator that indicates the current position 
within the temporal information of a currently displayed portion of the video (Figure 5). 

Referring to claim 34, Christel discloses the indicator changes location relative to the 
temporal information as the portion of the currently displayed portion of the video changes 
(Figure 5). 

Referring to claim 36, Christel discloses indicating with an indicator the current position 
within the temporal information of a currently displayed portion of said video and modifying the 
position of the indicator within the temporal information, which modifies the displayed portion 
of the video (Figures 5 and 6). 

Referring to claim 37, Christel discloses that the indicator is modified to a portion of the 
video that is not included within the plurality of segments (Figures 5 and 6). 
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Referring to claim 38, Christel discloses the first type of content and second type of 
content are selectable by a user for presentation to the user (Figure 5, page 5, column 1, lines 9- 
12 and Figure 6). 

Referring to claims 39 and 60, Christel discloses that at least two of the plurality of 
segments are temporally overlapping (page 4, column 2, lines 26-29). 

Referring to claims 40 and 61, Christel discloses that the temporally overlapping 
segments are visually indicated in a manner such that each of the overlapping segments are 
independently identifiable (page 4, column 2, lines 26-31). 

Referring to claim 41, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments (Figure 6). 

Referring to claim 42, Christel discloses that one of the plurality of segments is the 
segment most temporally adjacent to the portion of the video (Figure 6). 

Referring to claim 43, Christel discloses that one of the plurality of segments is the next 
temporally related segment (Figure 6). 

Referring to claim 44, Christel discloses that the plurality of segments is the previous 
temporally related segment (Figure 6). 

Referring to claim 45, Christel discloses that a user selects a portion of the video included 
within the plurality of segments, wherein in response thereto, the system presents the portion of 
the video from the start thereof (page 5, column 1, lines 5-11). 

Referring to claim 46, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
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the plurality of segments, and wherein the user selects a portion of the video included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the video 
within the plurality of segments (page 5, column 1, lines 5-1 1 and Figure 6). 

Referring to claim 47, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments, and wherein the user selects a portion of the video included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the video 
within the plurality of segments starting from the beginning thereof (page 5, column 1, lines 5-11 
and Figure 6). 

Referring to claim 48, Christel discloses that a user selects a portion of video not included 
within the plurality of segments, wherein in response thereto, the system presents the selected 
portion not included within the plurality of segments, and wherein after presenting the selected 
portion not included within the plurality of segments presents the selected plurality of segments 
in temporal order without portions of the video not included within the plurality of segments, and 
wherein the user selects a portion of the video included within the plurality of segments, wherein 
in response thereto, the system presents the portion of the video within the plurality of segments 
(page 5, column 1, lines 5-1 1 and Figure 6). 

Referring to claim 49, Christel discloses that the temporal information is hierarchical and 
is displayed in such a manner to retain a portion of its hierarchical structure (Figure 6). 

Referring to claim 50, Christel discloses that temporal information relates to overlapping 
time periods and the temporal information is displayed in such a manner to maintain the 
differentiation of the overlapping time periods (FigureS and page 4, column 2, lines 26-3 1). 
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Referring to claims 51 and 72, Christel discloses that the temporal information is 
displayed within a time line, wherein the temporal information is presented in a plurality of 
layers in a direction perpendicular to the length of the time line (Figure 5). 

Referring to claims 52 and 73, Christel discloses that the temporal information is 
displayed within a time line, wherein textual information is included within the time line (Figure 
6). 

Referring to claims 53 and 74, Christel discloses that additional textual information is 
displayed upon selecting a portion of the time line (Figure 6). 

Referring to claims 54 and 75, Christel discloses that temporal information is displayed 
together with a time line, wherein additional textual information is displayed together with 
selecting a portion of the time line (Figure 6). 

Referring to claims 55 and 76, Christel discloses that temporal information is displayed 
within a time line, wherein additional audio annotation is presented upon presenting a portion of 
the time line (page 4, column 1, lines 33-37 and Figure 6). 

Referring to claim 56, Christel discloses a method of presenting information regarding 
audio (page 2, column 2, lines 11-19). Christel discloses identifying a plurality of different 
segments of the audio, where each of the segments includes a temporal duration of the audio 
(page 4, column 2, lines 8-32). Christel discloses displaying, simultaneously with the segment of 
the audio, a graphical user interface including information regarding the temporal location of the 
segments, relative to at least one other of segment of the audio (Figure 5). Christel discloses 
displaying the temporal location for a first type of content of the audio using a first visual 
indication (Figure 5), wherein this is represented as the gray blocks at the bottom of the window 
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and displaying the temporal location for second type of content of the audio using a second 
visual indication different from the first visual indication (Figure 5), wherein the white lines 
showing the match locations represents the second visual indication. 

Referring to claim 58, Christel discloses indicating with an indicator the current position 
within the temporal information of a currently displayed portion of said audio and modifying the 
position of the indicator within the temporal information, which modifies the displayed portion 
of the audio (Figures 5 and 6). 

Referring to claim 59, Christel discloses that the indicator is modified to a portion of the 
audio that is not included within the plurality of segments (Figures 5 and 6). 

Referring to claim 62, Christel discloses that a user selects a portion of the audio not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments (Figure 6). 

Referring to claim 63, Christel discloses that one of the plurality of segments is the 
segment most temporally adjacent to the portion of the audio (Figure 6). 

Referring to claim 64, Christel discloses that one of the plurality of segments is the next 
temporally related segment (Figure 6). 

Referring to claim 65, Christel discloses that the plurality of segments is 
the previous temporally related segment (Figure 6). 

Referring to claim 66, Christel discloses that a user selects a portion of the audio included 
within the plurality of segments, wherein in response thereto, the system presents the portion of 
the audio from the start thereof (page 5, column 1, lines 5-1 1). 
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Referring to claim 67, Christel discloses that a user selects a portion of the audio not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments, and wherein the user selects a portion of the audio included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the audio 
within the plurality of segments (page 5, column 1, lines 5-1 1 and Figure 6). 

Referring to claim 68, Christel discloses that a user selects a portion of the audio not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments, and wherein the user selects a portion of the audio included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the audio 
within the plurality of segments starting from the beginning thereof (page 5, column 1, lines 5-1 1 
and Figure 6). 

Referring to claim 69, Christel discloses that a user selects a portion of audio not included 
within the plurality of segments, wherein in response thereto, the system presents the selected 
portion not included within the plurality of segments, and wherein after presenting the selected 
portion not included within the plurality of segments presents the selected plurality of segments 
in temporal order without portions of the audio not included within the plurality of segments, and 
wherein the user selects a portion of the audio included within the plurality of segments, wherein 
in response thereto, the system presents the portion of the audio within the plurality of segments 
(page 5, column 1, lines 5-1 1 and Figure 6). 

Referring to claim 70, Christel discloses that the temporal information is hierarchical and 
is displayed in such a manner to retain a portion of its hierarchical structure (Figure 6). 
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Referring to claim 71, Christel discloses that temporal information relates to overlapping 
time periods and the temporal information is displayed in such a manner to maintain the 
differentiation of the overlapping time periods (Figure5 and page 4, column 2, lines 26-31). 

Referring to claim 77, Christel discloses a user selectable skip function skips a set of 
frames to a modified location of the video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays the video at the modified location (Figure 6). 

Referring to claim 78, Christel discloses a user selectable skip function skips to a later 
temporal segment or a previous temporal segment, and displays video at the later temporal 
segment or the previous temporal segment, respectively (Figure 6). 

Referring to claim 79, Christel discloses that a user selectable scan function skips a set of 
frames to a modified location of the video in at least one of a forward temporal direction or a 
reverse temporal direction, and displays the video at the modified location, and thereafter 
automatically skips another set of frames to another modified location of the video in at least one 
of the forward temporal direction or the reverse temporal direction, and displays 
the video at another modified location (Figure 6). 

Referring to claim 80, Christel discloses that at least one of the forward temporal 
direction and reverse temporal direction are consistent with the different segments (Figure 6). 

Referring to claim 81, Christel discloses that the display of the video is at the start of the 
respective one of the different segments (Figure 6). 

Referring to claim 82, Christel discloses that the display of the video is at a 
predetermined offset within the respective one of the different segments (Figure 6). 
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Referring to claim 83, Christel discloses that the graphical user interface displays a 
respective image associated with at least a plurality of the different segments (Figure 6). 

Referring to claim 84, Christel discloses that the respective image associated with the 
currently presented different segments is visually highlighted (Figure 6). 

Referring to claim 85, Christel discloses that during presentation of the video visually 
highlighted respective images are highlighted in a substantially regular interval while the 
sequence of the presentation of the video is at substantially irregular intervals (Figure 6). 

Referring to claim 86, Christel discloses presentation of the different segments may be 
modified by a plurality of different functions, and wherein the user may customize another 
function, not previously explicitly provided, by combing a plurality of the plurality of different 
functions into a single function (page 5, column 1, lines 9-1 1 and Figure 6). 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-7 and 9-28 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Christel. 

Referring to claims 1 and 2, Christel discloses a method of presenting information 
regarding a video with a plurality of frames (page 2, column 2, lines 11-19). Christel discloses 
summarizing a video by identifying a plurality of segments of the video based upon an event 
(page 4, column 2, lines 28-32). Christel discloses that each of the segments includes a plurality 
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of sequential frames of the video (page 4, column 2, lines 8-20). Christel discloses displaying a 
summarization in a first portion of a display (Figure 5), wherein the first portion discloses a 
snapshot of a skim and indicating the sequences that make up the skim at the bottom of the 
window. Christel discloses displaying a graphical user interface on a second portion of the 
display, sequentially indicating the relative location of the plurality of segments within the 
summarization relative to at least one other of the segments as each of the plurality of segments 
is displayed (Figure 5), wherein the second portion displays the match locations in relation to the 
location of plurality of segments within the summarization. Christel discloses displaying the 
relative location for a first type of content of the video using a first visual indication (Figure 5), 
wherein this is represented as the gray blocks at the bottom of the window and displaying the 
relative location for second type of content of the video using a second visual indication different 
from the first visual indication (Figure 5), wherein the white lines showing the match locations 
represents the second visual indication. Christel does not explicitly disclose that the event being 
captured is characterized by a play, wherein this play is of a sport. It would have been obvious 
for one skilled in the art at the time of the invention that the event being captured is characterized 
by a play within a sport. Christel includes all types of video when discussing capturing of 
important events from a video, wherein based on the content of the video, any important events 
relevant to that specific video would be captured. Christel discloses that the goal of the 
invention is to display the essential content of a video, and wherein it is obvious that when the 
video is that of a sporting event, the essential content would be the plays and hence it would be 
obvious for Christel to captures these plays, wherein these plays are those that are part of a 
sporting event. 
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Referring to claim 3, Christel discloses a generally rectangular region where each of the 
plurality of segments is indicated within the generally rectangular region (Figure 5). 

Referring to claim 4, Christel discloses that the size of each of the plurality of segments is 
indicated in a manner such that the plurality of segments with a greater number of frames are 
larger than the plurality of segments with a lesser number of frames (Figure 5). 

Referring to claim 5, Christel discloses that the size of the regions between each of the 
plurality of segments is indicated in a manner such that the regions between with a greater 
number of frames are larger than plurality of segments with a lesser number of frames (Figure 5). 

Referring to claim 6, Christel discloses an indicator that indicates the current position 
within the temporal information of a currently displayed portion of the video (Figure 5). 

Referring to claim 7, Christel discloses the indicator changes location relative to the 
temporal information as the portion of the currently displayed portion of the video changes 
(Figure 5). 

Referring to claim 9, Christel discloses indicating with an indicator the current position 
within the temporal information of a currently displayed portion of said video and modifying the 
position of the indicator within the temporal information, which modifies the displayed portion 
of the video (Figures 5 and 6). 

Referring to claim 10, Christel discloses that the indicator is modified to a portion of the 
video that is not included within the plurality of segments (Figures 5 and 6). 

Referring to claim 1 1 , Christel discloses the first type of content and second type of 
content are selectable by a user for presentation to the user (Figure 5, page 5, column 1, lines 9- 
12 and Figure 6). 
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Referring to claim 12, Christel discloses that at least two of the plurality of segments are 
temporally overlapping (page 4, column 2, lines 26-29). 

Referring to claim 13, Christel discloses that the temporally overlapping segments are 
visually indicated in a manner such that each of the overlapping segments are independently 
identifiable (page 4, column 2, lines 26-31). 

Referring to claim 14, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments (Figure 6). 

Referring to claim 15, Christel discloses that one of the plurality of segments is the 
segment most temporally adjacent to the portion of the video (Figure 6). 

Referring to claim 16, Christel discloses that one of the plurality of segments is the next 
temporally related segment (Figure 6). 

Referring to claim 17, Christel discloses that the plurality of segments is the previous 
temporally related segment (Figure 6). 

Referring to claim 1 8, Christel discloses that a user selects a portion of the video included 
within the plurality of segments, wherein in response thereto, the system presents the portion of 
the video from the start thereof (page 5, column 1, lines 5-11). 

Referring to claim 19, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments, and wherein the user selects a portion of the video included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the video 
within the plurality of segments (page 5, column 1, lines 5-1 1 and Figure 6). 



Application/Control Number: 10/016,941 Page 14 

Art Unit: 2173 

Referring to claim 20, Christel discloses that a user selects a portion of the video not 
included within the plurality of segments, wherein in response thereto, the system presents one of 
the plurality of segments, and wherein the user selects a portion of the video included within the 
plurality of segments, wherein in response thereto, the system presents the portion of the video 
within the plurality of segments starting from the beginning thereof (page 5, column 1, lines 5-1 1 
and Figure 6). 

Referring to claim 21, Christel discloses that a user selects a portion of video not included 
within the plurality of segments, wherein in response thereto, the system presents the selected 
portion not included within the plurality of segments, and wherein after presenting the selected 
portion not included within the plurality of segments presents the selected plurality of segments 
in temporal order without portions of the video not included within the plurality of segments, and 
wherein the user selects a portion of the video included within the plurality of segments, wherein 
in response thereto, the system presents the portion of the video within the plurality 
of segments (page 5, column 1, lines 5-1 1 and Figure 6). 

Referring to claim 22, Christel discloses that the temporal information is hierarchical and 
is displayed in such a manner to retain a portion of its hierarchical structure (Figure 6). 

Referring to claim 23, Christel discloses that temporal information relates to overlapping 
time periods and the temporal information is displayed in such a manner to maintain the 
differentiation of the overlapping time periods (FigureS and page 4, column 2, lines 26-31). 

Referring to claim 24, Christel discloses that the temporal information is displayed within 
a time line, wherein the temporal information is presented in a plurality of layers in a direction 
perpendicular to the length of the time line (Figure 5). 
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Referring to claim 25, Christel discloses that the temporal information is displayed within 
a time line, wherein textual information is included within the time line (Figure 6). 

Referring to claim 26, Christel discloses that additional textual information is displayed 
upon selecting a portion of the time line (Figure 6). 

Referring to claim 27, Christel discloses that temporal information is displayed together 
with a time line, wherein additional textual information is displayed together with selecting a 
portion of the time line (Figure 6). 

Referring to claim 28, Christel discloses that temporal information is displayed within a 
time line, wherein additional audio annotation is presented upon presenting a portion of the time 
line (page 4, column 1, lines 33-37 and Figure 6). 

Response to Arguments 
4. Applicant's arguments filed 6/2/05 have been fully considered but they are not 
persuasive. 

With respect to Applicant's arguments that Christel does not disclose multiple frames and 
the graphical user interface of the disclosed claims. Christel discloses a sequence of displaying 
frames, that represent filmstrips, wherein a shot within these filmstrips represents multiple 
frames and wherein the thumbnail does not necessarily represent just one frame (page 2, column 
1, lines 19-24), and furthermore, Figures 5 and 6 display a further graphical user interface as 
claimed in the present invention. 

With respect to Applicant's arguments that Christel does not disclose information based 
on types of content and further visual indications. Christel discloses as shown in Figures 5 and 6 
and discussed in column 1 of page 5, the types of content included, one set of all sequences of a 
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frame, and another set of match locations of video or audio data, wherein denoting two different 
types of content, one type being all sequences and the other type being the matched locations of 
the sequences. The visual indications are displayed as gray blocks representing the general 
sequence of video data and the white blocks that represent relative data of match locations from 
the first set of data, both displaying two distinct means of visually indicating the necessary data. 

Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. Responses to this action should be submitted as per the options cited 
below: The United States Patent and Trademark Office requires most patent related 
correspondence to be: a) faxed to the Central Fax number (571-273-8300) (updated as of July 1 
5, 2005), b) hand carried or delivered to the Customer Service Window (located at the Randolph 
Building, 401 Dulany Street, Alexandria, VA 22314), c) mailed to the mailing address set forth 
in 37 CFR 1 . 1 (e.g., P.O. Box 1450, Alexandria, VA 22313-1450), or d) transmitted to the 
Office using the Office's Electronic Filing System. On July 15, 2005, the Central Facsimile 
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(FAX) Number will change from 703-872-9306 to 571-273-8300. Faxes sent to the old number 
will be routed to the new number until September 15, 2005. After September 15, 2005, the old 
number will no longer be in service and 571-273-8300 will be the only facsimile number 
recognized for "centralized delivery." The official notice dated June 20, 2005 also includes an 
"updated list of exceptions to the centralized delivery and facsimile transmission policy for 
patent related correspondence." Questions regarding this notice may be e-mailed to 
Patentpractice@uspto.gov, or directed to the Inventors' Assistance Center by telephone at 800- 
786-9199, or 571-272-1000. Any inquiry concerning this communication or earlier 
communications from the examiner should be directed to Namitha Pillai whose telephone 
number is (571) 272-4054. The examiner can normally be reached on 8:30 AM - 5:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. 

All Internet e-mail communications will be made of record in the application file. PTO 
employees do not engage in Internet communications where there exists a possibility that 
sensitive information could be identified or exchanged unless the record includes a properly 
signed express waiver of the confidentiality requirements of 35 U.S.C. 122. This is more clearly 
set forth in the Interim Internet Usage Policy published in the Official Gazette of the Patent and 
Trademark on February 25, 1997 at 1 195 OG 89. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Group receptionist whose telephone number is (571) 272-2100. 



Namitha Pillai 
Assistant Examiner 
Art Unit 2 173 
August 16, 2005 
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